Status of the health information system in Ireland and its fitness to support health system performance assessment: a multimethod assessment based on stakeholder involvement.

BACKGROUND: Between 2019 and 2021, the first Irish health system performance assessment (HSPA) framework was developed. As routinely collected health data are necessary to continuously populate indicators of an HSPA framework, a purpose-driven assessment of the health information system (HIS) in Ireland and its fitness to support the implementation of an HSPA framework was conducted. This study reports on the status of the Irish HIS through a multimethod assessment based on continuous broad stakeholder involvement. METHODS: Between May and November 2020, over 50 informants were engaged in individual and group interviews and stakeholder consultation workshops as part of the HIS assessment process. Descriptive themes and high-level data availability heatmaps were derived from interview and workshop data using thematic analysis. Indicator "passports" for the HSPA framework were populated during stakeholder consultation workshops and analysed using univariate descriptive statistics. RESULTS: The HIS in Ireland was able to provide administrative, survey and registry-based data for public sector acute care services, focusing on structure, process and output metrics. Significant data availability gaps, most notably from primary care, private hospitals and community care, were reported, with little availability of electronic health record and people-reported data. Data on outcome metrics were mostly missing, as were linkage possibilities across datasets for care pathway monitoring. The COVID-19 pandemic highlighted the national HIS's shortcomings but also the capacity for rapid development and improvement. CONCLUSIONS: A tailor-made assessment of the HIS in Ireland, involving a broad set of relevant stakeholders, revealed strengths, weaknesses and areas for improvement in the Irish health data landscape. It also contributed to the development of a national HSPA framework and momentum to further strengthen data infrastructure and governance, while working towards a more data-driven and person-centred healthcare system. This work demonstrates the utility of an inclusive HIS assessment process and is applicable beyond Ireland, where this case study was conducted.

Rapidly adapting primary care sentinel surveillance across seven countries in Europe for COVID-19 in the first half of 2020: strengths, challenges, and lessons learned.

As the COVID-19 pandemic began in early 2020, primary care influenza sentinel surveillance networks within the Influenza - Monitoring Vaccine Effectiveness in Europe (I-MOVE) consortium rapidly adapted to COVID-19 surveillance. This study maps system adaptations and lessons learned about aligning influenza and COVID-19 surveillance following ECDC / WHO/Europe recommendations and preparing for other diseases possibly emerging in the future. Using a qualitative approach, we describe the adaptations of seven sentinel sites in five European Union countries and the United Kingdom during the first pandemic phase (March-September 2020). Adaptations to sentinel systems were substantial (2/7 sites), moderate (2/7) or minor (3/7 sites). Most adaptations encompassed patient referral and sample collection pathways, laboratory testing and data collection. Strengths included established networks of primary care providers, highly qualified testing laboratories and stakeholder commitments. One challenge was the decreasing number of samples due to altered patient pathways. Lessons learned included flexibility establishing new routines and new laboratory testing. To enable simultaneous sentinel surveillance of influenza and COVID-19, experiences of the sentinel sites and testing infrastructure should be considered. The contradicting aims of rapid case finding and contact tracing, which are needed for control during a pandemic and regular surveillance, should be carefully balanced.

Effectiveness of complete primary vaccination against COVID-19 at primary care and community level during predominant Delta circulation in Europe: multicentre analysis, I-MOVE-COVID-19 and ECDC networks, July to August 2021.

IntroductionIn July and August 2021, the SARS-CoV-2 Delta variant dominated in Europe.AimUsing a multicentre test-negative study, we measured COVID-19 vaccine effectiveness (VE) against symptomatic infection.MethodsIndividuals with COVID-19 or acute respiratory symptoms at primary care/community level in 10 European countries were tested for SARS-CoV-2. We measured complete primary course overall VE by vaccine brand and by time since vaccination.ResultsOverall VE was 74% (95% CI: 69-79), 76% (95% CI: 71-80), 63% (95% CI: 48-75) and 63% (95% CI: 16-83) among those aged 30-44, 45-59, 60-74 and ≥ 75 years, respectively. VE among those aged 30-59 years was 78% (95% CI: 75-81), 66% (95% CI: 58-73), 91% (95% CI: 87-94) and 52% (95% CI: 40-61), for Comirnaty, Vaxzevria, Spikevax and COVID-19 Vaccine Janssen, respectively. VE among people 60 years and older was 67% (95% CI: 52-77), 65% (95% CI: 48-76) and 83% (95% CI: 64-92) for Comirnaty, Vaxzevria and Spikevax, respectively. Comirnaty VE among those aged 30-59 years was 87% (95% CI: 83-89) at 14-29 days and 65% (95% CI: 56-71%) at ≥ 90 days between vaccination and onset of symptoms.ConclusionsVE against symptomatic infection with the SARS-CoV-2 Delta variant varied among brands, ranging from 52% to 91%. While some waning of the vaccine effect may be present (sample size limited this analysis to only Comirnaty), protection was 65% at 90 days or more between vaccination and onset.

Engaging citizens in the development of a health system performance assessment framework: a case study in Ireland.

BACKGROUND: The launch in 2017 of the Irish 10-year reform programme Sláintecare represents a key commitment in the future of the health system. An important component of the programme was the development of a health system performance assessment (HSPA) framework. In 2019, the Department of Health of Ireland (DoH) and Health Service Executive (HSE) commissioned the technical support of researchers to develop an outcome-oriented HSPA framework which should reflect the shared priorities of multiple stakeholders, including citizens. This study describes the method applied in the Irish context and reflects on the added value of using a citizen panel in the development of an HSPA framework. METHODS: A panel of 15 citizens was convened, recruited by a third-party company using a sampling strategy to achieve a balanced mix representing the Irish society. Panellists received lay-language preparatory materials before the meeting. Panellists used a three-colour scheme to signal the importance of performance measures. An exit questionnaire was administered to understand how participants experienced being part of the panel. The citizen panel was the first in a series of three panels towards the development of the HSPA framework, followed by panels including representatives of the DoH and HSE, and representatives from professional associations and special interest groups. RESULTS: The citizen panel generated 249 health performance measures ranging across 13 domains. Top-ranking domains to the citizen panel (people-centredness, coordination of care, and coverage) were less prioritized by the other panels; domains less prioritized by the citizen panel, such as accessibility, responsiveness, efficiency, and effectiveness, were of higher priority in the other panels. Citizen panellists shared a similar understanding of what a citizen panel involves and described their experience at the panel as enjoyable, interesting, and informative. CONCLUSIONS: The priorities of the citizen panel were accounted for during all phases of developing the HSPA framework. This was possible by adopting an inclusive development process and by engaging citizens early on. Citizen engagement in HSPA development is essential for realizing citizen-driven healthcare system performance and generating trust and ownership in performance intelligence. Future research could expand the use of citizen panels to assess, monitor, and report on the performance of healthcare systems.

Features Constituting Actionable COVID-19 Dashboards: Descriptive Assessment and Expert Appraisal of 158 Public Web-Based COVID-19 Dashboards.

BACKGROUND: Since the outbreak of COVID-19, the development of dashboards as dynamic, visual tools for communicating COVID-19 data has surged worldwide. Dashboards can inform decision-making and support behavior change. To do so, they must be actionable. The features that constitute an actionable dashboard in the context of the COVID-19 pandemic have not been rigorously assessed. OBJECTIVE: The aim of this study is to explore the characteristics of public web-based COVID-19 dashboards by assessing their purpose and users ("why"), content and data ("what"), and analyses and displays ("how" they communicate COVID-19 data), and ultimately to appraise the common features of highly actionable dashboards. METHODS: We conducted a descriptive assessment and scoring using nominal group technique with an international panel of experts (n=17) on a global sample of COVID-19 dashboards in July 2020. The sequence of steps included multimethod sampling of dashboards; development and piloting of an assessment tool; data extraction and an initial round of actionability scoring; a workshop based on a preliminary analysis of the results; and reconsideration of actionability scores followed by joint determination of common features of highly actionable dashboards. We used descriptive statistics and thematic analysis to explore the findings by research question. RESULTS: A total of 158 dashboards from 53 countries were assessed. Dashboards were predominately developed by government authorities (100/158, 63.0%) and were national (93/158, 58.9%) in scope. We found that only 20 of the 158 dashboards (12.7%) stated both their primary purpose and intended audience. Nearly all dashboards reported epidemiological indicators (155/158, 98.1%), followed by health system management indicators (85/158, 53.8%), whereas indicators on social and economic impact and behavioral insights were the least reported (7/158, 4.4% and 2/158, 1.3%, respectively). Approximately a quarter of the dashboards (39/158, 24.7%) did not report their data sources. The dashboards predominately reported time trends and disaggregated data by two geographic levels and by age and sex. The dashboards used an average of 2.2 types of displays (SD 0.86); these were mostly graphs and maps, followed by tables. To support data interpretation, color-coding was common (93/158, 89.4%), although only one-fifth of the dashboards (31/158, 19.6%) included text explaining the quality and meaning of the data. In total, 20/158 dashboards (12.7%) were appraised as highly actionable, and seven common features were identified between them. Actionable COVID-19 dashboards (1) know their audience and information needs; (2) manage the type, volume, and flow of displayed information; (3) report data sources and methods clearly; (4) link time trends to policy decisions; (5) provide data that are "close to home"; (6) break down the population into relevant subgroups; and (7) use storytelling and visual cues. CONCLUSIONS: COVID-19 dashboards are diverse in the why, what, and how by which they communicate insights on the pandemic and support data-driven decision-making. To leverage their full potential, dashboard developers should consider adopting the seven actionability features identified.

Development and Actionability of the Dutch COVID-19 Dashboard: Descriptive Assessment and Expert Appraisal Study.

BACKGROUND: Web-based public reporting by means of dashboards has become an essential tool for governments worldwide to monitor COVID-19 information and communicate it to the public. The actionability of such dashboards is determined by their fitness for purpose-meeting a specific information need-and fitness for use-placing the right information into the right hands at the right time and in a manner that can be understood. OBJECTIVE: The aim of this study was to identify specific areas where the actionability of the Dutch government's COVID-19 dashboard could be improved, with the ultimate goal of enhancing public understanding of the pandemic. METHODS: The study was conducted from February 2020 to April 2021. A mixed methods approach was carried out, using (1) a descriptive checklist over time to monitor changes made to the dashboard, (2) an actionability scoring of the dashboard to pinpoint areas for improvement, and (3) a reflection meeting with the dashboard development team to contextualize findings and discuss areas for improvement. RESULTS: The dashboard predominantly showed epidemiological information on COVID-19. It had been developed and adapted by adding more in-depth indicators, more geographic disaggregation options, and new indicator themes. It also changed in target audience from policy makers to the general public; thus, a homepage was added with the most important information, using news-like items to explain the provided indicators and conducting research to enhance public understanding of the dashboard. However, disaggregation options such as sex, socioeconomic status, and ethnicity and indicators on dual-track health system management and social and economic impact that have proven to give important insights in other countries are missing from the Dutch COVID-19 dashboard, limiting its actionability. CONCLUSIONS: The Dutch COVID-19 dashboard developed over time its fitness for purpose and use in terms of providing epidemiological information to the general public as a target audience. However, to strengthen the Dutch health system's ability to cope with upcoming phases of the COVID-19 pandemic or future public health emergencies, we advise (1) establishing timely indicators relating to health system capacity, (2) including relevant data disaggregation options (eg, sex, socioeconomic status), and (3) enabling interoperability between social, health, and economic data sources.

Vaccine effectiveness against symptomatic SARS-CoV-2 infection in adults aged 65 years and older in primary care: I-MOVE-COVID-19 project, Europe, December 2020 to May 2021.

We measured COVID-19 vaccine effectiveness (VE) against symptomatic SARS-CoV-2 infection at primary care/outpatient level among adults ≥ 65 years old using a multicentre test-negative design in eight European countries. We included 592 SARS-CoV-2 cases and 4,372 test-negative controls in the main analysis. The VE was 62% (95% CI: 45-74) for one dose only and 89% (95% CI: 79-94) for complete vaccination. COVID-19 vaccines provide good protection against COVID-19 presentation at primary care/outpatient level, particularly among fully vaccinated individuals.